WEARABLE DISPLAY AND METHOD OF DISPLAYING IMAGES 
USING A WEARABLE DISPLAY 

1 FIELD OF THE INVENTION 

2 The present invention relates to a method and apparatus for displaying images. 

3 More particularly, the present invention relates to displaying images using wearable 

4 displays. 
5 

6 BACKGROUND OF THE INVENTION 

7 In general, apparatuses for displaying images are known. An example of an 



8 apparatus for displaying images to a user is a head-mounted display system. Head-mounted 

9 display systems can be generally referred to as "wearable displays," because they are 

10 supported by a user while in use. Conventional wearable display systems typically include 

1 1 a head-mounted portion, the head-mounted portion having image-generating devices for 

12 generating images viewable by the user. Wearable display systems convey visual 

13 information, such as data from sensing devices, programmed entertainment such as moving 

14 or still images, and computer generated information. The visual information may be 

15 accompanied by audio signals for reception by a user's ears. A conventional wearable 

16 display system 10 is illustrated by Figs. 1 and 2. 

17 The conventional wearable display system 10 includes a head-mounted portion 12, 

18 which includes right and left image displays 16, 18 and right and left eyepiece optics 20, 22, 

19 for displaying images to a user's eyes 21, 23. A controller 25 conveys image signals to the 

20 head-mounted portion 12 via a cable 14 having right and left lines 24, 26 for conveying 

21 image signals to the right and left image displays 16, 18, respectively. The controller 25 is 
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comprised of an image source 30, which transmits image data to a processor 28, which then 




2 


formats the data for transmission to the right and left image displays 16, 18. 




3 


The right and left image displays 16, 18 are flat panel displays capable of displaying 




4 


an n X n array of individual points of light, or "pixels." These types of matrix display 




5 


devices are commonly referred to as "microdisplays." The term "microdisplay" describes 




6 


devices such as liquid crystal displays (LCDs), light emitting displays (LEDs), and scanning 




7 


devices using cathode ray tubes (CRT's) or laser diodes. Fig. 3 illustrates an n x n array of 




8 


pixels of a typical microdisplay, with the size of individual pixel elements exaggerated for 




9 


illustrative purposes. An n x n array such as the one illustrated by Fig. 3 is typically 




10 


described in terms of its "resolution," which is measured as the number of pixels per unit 




11 


area of the display. The n x n pixels illustrated in Fig. 3 are of uniform size. While this 


iu 

If! 


12 


configuration is capable of generating a high resolution image, the uniform size of the pixels 


la 


13 


is inefficient, because the human eye cannot appreciate the relatively high degree of 




14 


resolution along the edges of the conventional array. This phenomenon is illustrated by 




15 


Figs. 4 and 5. 




16 


Fig. 4 illustrates a vertical range of vision diagram for a human viewer, the range of 
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vision establishing a human's field of vision. Fig. 5 illustrates the regions of varying visual 


18 


acuity for a human's left and right eyes while viewing an image together. The inner region 




19 


30 of the diagram is a region of relatively high visual acuity. The shaded outer region 32 in 




20 


the diagram illustrates the portion of a person's field of vision that is of low acuity, but 




21 


which is also very sensitive to changes in brightness and motion. The outer region 32 




22 


includes the peripheral vision. A similar diagram can be constructed for the regions of 




23 


varying acuity as perceived by a single eye. As illustrated by Fig. 5, the acuity of the eyes 




24 


decreases with increasing angular deviation (both horizontal and vertical) fi-om the line of 




25 


sights. It is therefore undesirable to provide high resolution along the edges of an array, as 



HP 10006196-1 



2 



1 in the wearable display system 10, because the cost of display devices increases with 

2 resolution, and high resolution at the edges of displays provides little viewing benefit to the 

3 user of the wearable display system 1 0. Further, the cost to store, process, and transfer very 

4 high resolution signals further increases the cost of the wearable display system 1 0. 

5 One conventional approach to the above problem is the use of display devices 

6 having variable resolution. One such device is disclosed in U.S. Patent No. 4,479,784 to 

7 Mallinson et al. Mallinson's device uses a bifurcated projection system to project an image 

8 onto a screen for viewing by a trainee. A region of high resolution imagery is projected 

9 onto a center portion of the screen by a foveal projection system, and a region of low 
10 resolution is projected by a peripheral projection system. While Mallinson's device 

S 1 1 accommodates the varying acuity of the user, his system would require large and complex 

U! 12 optics and light levels to project into the user's far peripheral viewing region. 
h| J 3 U.S. Patent No. 5,071,209 to Chang etal. discloses a similar device, in which a 

Q 1 4 processor creates images from pixels, with pixel size decreasing with increasing distance 

15 from the center of the image. To extend image features into the periphery, Chang's device 

m 

^ 16 would require a large and complex optical system to fijrther extend the main microdisplay 

1 7 pixels into the user's far peripheral viewing region. 

18 In U.S. Patent No. 6,1 15,007, Yamazaki utilizes a liquid crystal flat panel display 

19 having pixels of varying width. Yamazaki, however, utilizes varying pixel width to account 

20 for distortion at the horizontal extremes of the viewer's vision. Yamazaki's device also 

21 requires complex control architecture to generate images on the flat panel display. 

22 There is therefore a need for a method of displaying images on a wearable display 

23 and for wearable display that accommodate the varying acuity of the human eye, and that 

24 present a wide field of view to a user. 
25 
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1 SUMMARY OF THE INVENTION 

2 The present invention overcomes the shortcomings of the conventional art and may 

3 achieve other advantages not contemplated by the conventional art. 

4 According to a first aspect of the invention, images are displayed using a wearable 



5 display by generating an inner region display signal, generating an outer region display 

6 signal using at least one of a motion, brightness or color characteristic from the inner region 

7 display signal, displaying an inner region of an image on a display using the inner region 

8 display signal, and displaying an outer region of the image on the display using the outer 

9 region display signal. The outer region is of substantially lower resolution than the inner 
10 region. 



1 1 According to the first aspect, a display has an outer region of low resolution, which 

12 may lie outside of the eye's foveal field of view. The viewing experience is enhanced by 

13 the increase in the size of the image due to the presence of the outer region, and the low 

14 resolution does not detract from the viewing experience. 

1 5 According to a second aspect of the invention, the field of view of a wearable 



16 display is increased by adjusting image signal data to increase the size of an image 

17 displayed by the wearable display. The image signal data is adjusted so that an image 

1 8 conveyed by the image signal data is distorted, or "stretched," to extend into an outer region 

19 of a display. 



20 According to the second aspect, the size of the image in the user's field of view is 

21 increased by distorting the source image. The outer region of the source image may be 

22 selected so that it lies outside of the eyes' foveal field of view, so that the viewing 

23 experience is enhanced due to the increased size of the image. 

24 According to a third aspect of the invention, a wearable display includes a display, a 

25 controller for obtaining image signal data fi-om a source image signal and for generating a 
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1 display signal. Optics are arranged in the wearable display so as to modify an image 

2 displayed by the display and to distort the image displayed by the display so that a field of 

3 view of the image is increased. 

4 According to the third aspect, an outer, distorted region of an image may be selected 

5 so that it lies outside of the eyes' foveal field of view, so that the viewing experience is 

6 enhanced due to the increased size of the image presented by the optics. 

7 Other aspects and advantages of aspects of the invention will be discussed with 

8 reference to the drawings figures and to the detailed description of the preferred 

9 embodiments. 



10 

1 1 BRIEF DESCRIPTION OF THE DRAWING FIGURES 



Iff 12 Fig. 1 illustrates a conventional image display system. 

LiJ 13 Fig. 2 is a schematic diagram of the conventional wearable display system of Fig. 1 . 

O 14 Fig. 3 illustrates a conventional n x n pixel array. 

1=1 1 5 Fig. 4 is a vertical range of vision diagram. 

i- - 

O 16 Fig. 5 illustrates regions of varying visual acuity. 

C=l 17 Fig 6 is a schematic diagram of an image display device according to a first 

1 8 embodiment of the present invention. 

19 Fig. 7 illustrates a processor according to the embodiment of Fig. 6. 

20 Fig. 8 illustrates regions of a display. 

21 Fig, 9 is a flow chart illustrating a method of displaying images according to an 

22 embodiment of the present invention. 

23 Fig. 10 is a flow chart illustrating the generation of outer region display signals. 

24 Fig. 1 1 illustrates an alternative arrangement of the inner and outer regions of a 

25 display according to an embodiment of the present invention. 
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1 Fig. 12 is a schematic diagram of an alternative embodiment of an image display 

2 device according to the present invention, 

3 Fig. 13 illustrates an image generated by a display without distortion. 

4 Fig. 14 illustrates an image generated by a display with distortion. 

5 Fig. 15 is a flow chart illustrating a method of displaying images according to an 

6 alternative embodiment of the present invention. 

7 Fig. 16 illustrates an image display device for performing the method illustrated by 

8 Fig. 15. 



9 

0 DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 



1 1 A method and device for displaying images according to the present invention will 

12 be described below by way of preferred embodiments and with reference to the 

13 accompanying drawings. 

14 A first embodiment of the invention will be discussed with reference to Fig. 6, 



15 which is a schematic diagram of an image display device 40 having two displays, each for 

16 displaying an image to an eye of a user. The image display device 40 is a wearable display. 

17 The image display device 40 includes a right display 42 and a left display 44, the 

1 8 right display 42 for displaying an image to a right eye 45 of a user, and the left display 44 

19 for displaying an image to the user's left eye 47. A right optics 46 and a left optics 48 can be 

20 included to magnify or otherwise adjust the images displayed by the right and left displays 

2 1 42, 44, respectively. The right and left displays 42, 44 are arranged to receive display 

22 signals from a controller 50, which is arranged to receive a source image signal from an 

23 image source 58. The controller 50 includes a processor 54, a sampler 56, and an analog-to- 

24 digital converter (ADC) 57. 
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1 Fig. 7 is a schematic diagram illustrating the processor 54. The processor 54 

2 comprises an address calculator 53 disposed to receive image signal data from the sampler 

3 56, and a right frame buffer 55 and a left frame buffer 59 for receiving formatted image data 

4 from the address calculator 53. The elements comprising the controller 50 and the 

5 processor 54 are all illustrated as individual elements for the purposes of illustration, 

6 however, one or more of these elements can comprise routines or instructions stored on and 

7 executable by, for example, a processing unit or units, software and other computer readable 

8 media used in conjunction with a computing device, and other devices capable of executing 

9 stored instructions. 

10 The image display device 40 may also have audio capability, and an audio signal 

1 1 source 60 can be included to provide source audio signals to the controller 50. Speakers 62, 

12 64 may be arranged to receive audio signals from the controller 50 and to produce audio 

1 3 output from the audio signals. The audio output produced by the speakers 62, 64 can be 

14 correlated with the images displayed by the displays 42, 44 in order to create, for example, a 

1 5 desired entertainment program for the user. 

16 As illustrated by Fig. 6, the image source 58 is arranged in the image display device 

17 40 to transmit a source image signal (or signals) to the sampler 56. The image source 58 

1 8 can be a storage device capable of storing or buffering image data from an image generating 

19 source, a camera device for receiving actual images and reducing the images to electronic 

20 form, or a combination of the two devices. The term "source image signal" is used in this 

2 1 specification to indicate, for example, a digital or an analog signal containing data capable 

22 of describing a series of frames of images. If the source image signal is an analog signal, it 

23 can be digitized at the ADC 57 before sampling. Alternatively, the source image signal can 

24 be forwarded directly to the sampler 56, and processed in the controller 50 in the analog 

25 domain. The sampler 56 samples the source image signal and transmits the image signal 
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1 data to the processor 54. The processor 54 then converts the image signal data into display 

2 signals for display by the right and left displays 42, 44. 

3 According to one aspect of the invention, the right and left displays 42, 44 each 

4 include an inner region, and an outer region for generating an image of substantially lower 

5 resolution than the inner region. Fig, 8 illustrates an inner region 60, and an outer region 

6 70, of the right display 42. The right display 42 is discussed for the purposes of illustration 

7 only, and the left display 44 preferably has a similar configuration. 

8 The inner region 60 may be comprised of a first region 61, a second region 62 of 

9 lower resolution than the first region 6 1 , and a third region 63 of lower resolution than the 

10 second region 62. The resolution of the regions becomes lower ftirther away from the 

1 1 center of the right display 42, so that the resolution of regions of the image presented by the 

12 right display 42 do not exceed the capability of the human eye to appreciate the resolution. 

13 The outer region 70 is of substantially lower resolution than the inner region 60, and the 

14 image displayed by the outer region 70 may be generated using the motion, brightness, and 

1 5 color characteristics of the image displayed by the inner region 60, so that the image 

16 displayed by the outer region 70 is coordinated with the inner region 60. 

17 The first region 61 is of relatively high resolution, and lies in the central field of 

18 distinct vision - referred to as the field of "foveal" vision. The foveal field of vision is the 

19 generally conical field of view surrounding the line of sight / (see Fig. 4). In human beings, 

20 the foveal zone of the retina is used for detailed color and pattern vision. The surrounding 

2 1 peripheral zone is sensitive to grosser features of the outer visual field, with the peripheral 

22 area of the retina being especially sensitive to movement. The first region 6 1 , which is of 

23 the highest resolution, can be selected to extend over, for example, a 20 degree (10 degrees 

24 about the line of sight /) field of view, so as to generally correspond to the field of foveal 

25 vision, while allowing a small amount of eye movement about the center. The inner region 
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1 60, can extend over, for example, 40-50 degrees in the user's field of view, and may be 

2 expanded or contracted in order to accommodate a desired increase or decrease in the size 

3 of the relatively high resolution portion of the image displayed by the inner region 60. The 

4 size selected for the zones will depend on the nature of the use for the display. For example, 

5 if the image display device 40 is used to display text data, then the inner region 60 would be 

6 larger than if a relatively small field of view were of interest. 

7 The second region 62 may have a resolution that is lower than that of the first region 

8 61, and the third region 63 may have a resolution that is lower than that of the second region 

9 62. The first through third regions 61, 62, 63 need not be demarcated at the dividing lines 

10 illustrated in Fig. 8, and the right display 42 may instead form a continuous arrangement of 

1 1 individual pixels of substantially continuously increasing size outward fi-om the center of 

12 the center of the right display 42, The transition between regions of differing resolution can 

13 occur gradually, so that the transition is not noticeable to the user. The indication of first 

14 through third regions 61, 62, 63 can therefore be considered as a conceptual aid indicating 

1 5 decreasing resolution as distance from the center of the display increases. The decrease in 

16 resolution fi-om the center to the edges of the right display 42 is chosen according to the 

17 resolution required for the desired application. Because the eyes' acuity decreases rapidly 

18 outward from the line of sight ^, for a typical application, it is possible to utilize a resolution 

19 along the edge of the inner region 60 that is between 1/20'*' and 1/10"^ of the resolution at 

20 the center of the right display 42, 

21 The inner region 60 of the right display 42 can be constructed of a microdisplay 

22 capable of displaying, in general, a p x q array of individual pixels. Examples of 

23 microdisplays suitable for use in the present invention include liquid crystal displays 

24 (LCDs), light emitting displays (LEDs), electro-luminance (EL) displays, electro-chromic 

25 (EC) displays, and other displays capable of displaying individual pixels. Further, small 
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1 scanning display devices using CRTs, and laser diodes used to create small displays or write 

2 directly on the retina, may also be used. The resolution of microdisplays, as perceived by 

3 the eye, may be measured in cycles per degree (CPD). 20:20 vision is defined to be 30 

4 CPD, and 15 CPD equates to 20:40 vision. For a person v^ith 20:20 vision, increasing the 

5 CPD of a display above 30 CPD will not produce a measurable improvement in their ability 

6 to resolve more detail. 

7 The resolution of the first region 61 is selected to fit the desired application for the 

8 image display device 40, and may be, for example, between 15 and 40 CPD near the center 

9 of the first region. In the second region 62, the resolution can be in the range of, for 

10 example, 5 to 30 CPD. The resolution at the edge of the third region 63 can have a 

1 1 resolution in the range of, for example, 1 to 20 CPD. 

12 The outer region 70 is used to create images that are primarily generated in order to 

1 3 match the characteristics of the edges of the inner region 60. The characteristics preferably 

14 include one or more of the motion, color, and brightness of the image displayed in the inner 

1 5 region 60. The movement and brightness need not be exactly matched, and may instead be 

16 matched in a "gross" sense, which allows for some discontinuity between the inner region 

1 7 60 and the outer region 70. The outer region 70 can comprise, for example, a microdisplay 

1 8 as described above, or other illumination devices. However, in the outer region 70, the 

19 resolution is substantially lower than that of the inner region. The resolution of the outer 

20 region 70 can be less than, for example, 5 CPD, and may be in the range of, for example, 

21 .05 to 5 CPD. The outer region 70 extends from the outermost edge of the inner region 60, 

22 to a maximum field of view of, for example, 100-210 degrees across both eyes, so that a 

23 user's entire field of view is occupied by the image displayed. 

24 The outer region 70 can be constructed of arrays of sets of red, blue and green lights 

25 ("RGB sets"). The RGB sets can each be used to illuminate an individual point (or "pixel") 
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1 of the outer region 70, Because of the low resolution of the outer region 70, the RGB sets 

2 can be constructed of red, blue and green light bulbs or LED's. These light bulbs produce 

3 the visual equivalent to large, marginally delineated pixels, which may be referred to as 

4 "diffuse light." 

5 The outer region 70 may also include an array of individually controlled white 

6 lights, particularly in the range of a user's peripheral vision. Because the peripheral vision 

7 is particularly sensitive to motion, and not to color, white lights in the outer region 70 can 

8 convey enough motion information to improve the viewing experience for the user. White 

9 lights could, for example, be used within region 70 for this purpose. 

10 The resolution of the outer region 70 can also decrease with distance from the center 

1 1 of the right display 42. For example, the resolution at the outermost edges of the outer 

12 region 70 can be within, for example, .05 to 1 CPD. At the outermost edge of the right 

13 display 42, the resolution can be as low as .05 CPD, as this part of the display may 

14 correspond to the eye's most extreme peripheral vision. 

1 5 The operation of the embodiment of Figs. 6-8 will now be discussed with reference 

16 to Fig, 9. Fig. 9 is a flow chart illustrating a method of displaying images according to an 

17 embodiment of the present invention. According to the method of operation of the image 

1 8 display device 40, the controller 50 generates an inner region display signal using a source 

19 image signal, and generates an outer region display signal using the inner region display 

20 signal by determining, for example, one or more of the motion, brightness or color 

21 characteristics from the inner region display signal. The inner and outer region display 

22 signals are then used to display inner and outer regions of an image, respectively. 

23 In step SIO, the image source 58 transmits a source image signal to the controller 50. 

24 The sampler 56 samples the source image signal in step SI 2, and transmits the image signal 

25 data sampled from the source image signal to the processor 54. 
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1 In step S14, the processor 54 generates inner region display signals for both the right 

2 display 46 and the left display 48 using the image signal data sampled in step S12, The 

3 processor 54 generates the inner region display signals by forwarding the sampled image 

4 signal data to the address calculator 53 (see Fig. 7) and transmitting formatted right and left, 

5 inner region display data to the right and left frame buffers 55, 59, respectively. In this 

6 manner, a right inner region display signal is stored in the right frame buffer 55 for eventual 

7 display in the inner region 60 of the right display 42, and a left inner region display signal is 

8 stored in the left frame buffer 59 for display by an inner region (not illustrated) of the left 

9 display 44. 

10 The right and left inner region display signals generated in step S14 can be adapted 

1 1 for display on displays having an inner region 60 of, for example, first, second, and third 

12 regions 61, 62, 63 of differing resolution as illustrated by Fig. 8. Alternatively, the right 
bi 13 and left inner region display signals can be adapted for display on displays having an inner 

14 region of uniform resolution. 

Q 15 In step SI 6, the processor 54 generates a right outer region display signal for display 

'ill 

16 by the outer region 70 of the right display 42, and a left outer region display signal for 

P 1 7 display by an outer region (not illustrated) of the left display 44. The method for 

18 generating the right outer region display signal and the left inner region display signal is 

19 discussed below in detail with reference to Fig. 10. 

20 In step SI 8, a right display signal is transmitted to the right display 42, the right 

21 display signal being formed by the right inner image display signal and the right outer 

22 image display signal. Similarly, the left display signal is transmitted to the left display 44, 

23 the left display signal being formed by the left inner image display signal and the left outer 

24 image display signal. The right and left display signals are displayed on the right and left 

25 displays 42, 44, respectively, in step S20. 
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1 Fig. 10 illustrates the steps involved in generating outer region display signals, in 

2 particular the right outer region display signal, as recited in step S16 of Fig. 9. The 

3 following discussion is addressed to the right outer region display signal for illustrative 

4 purposes. The left outer region display signal may be generated in a manner similar to the 

5 right outer region display signal, using the left inner region display signal. In step S24, the 

6 processor 54 detects the motion, brightness, and color of an image to be displayed from the 

7 right inner region display signal. The right outer region display signal is then generated so 

8 that motion, brightness, and color of an image to be displayed by the outer region 70 are 

9 imparted with the motion, brightness and color of an image to be displayed by the inner 

10 region 60. 

1 1 The sense of motion conveyed by the right inner region display signal may be 

Lli 12 detected by an algorithm such as those used for creating MPEG motion vectors. The right 

bi 1 3 outer region 70 is of substantially lower resolution than the right inner region 60, and the 

Q 14 sense of motion from the right inner region 60 can be imparted to the lower resolution right 

D 15 outer region 70 by mapping current and extrapolated motion information into the outer 

Ul 

U 16 display regions by predetermined information in the signal source, or predicted information 

C J 1 7 from the motion vectors that is extended into the outer display regions. The brightness and 

18 color conveyed by the inner region display signal may be detected by analysis of the image 

19 information near the edges of the image, and combining this information with motion 

20 vectors when broad movement (e.g. panning) is detected. The brightness and color of the 

21 right inner region 60 can be imparted to the lower resolution right outer region 70 by 

22 generating illuminator control signals based on the analysis of brightness and color 

23 information in the original image information. Using the above operations, a right outer 

24 region display signal can be generated that will generate an image in the outer region 70 of 
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1 the right display 42 of substantially lower resolution than the inner region 60 of the right 

2 display 42, but that is imparted with the motion, brightness and color of the inner region. 

3 The left outer image display signal can be generated in a manner similar to the right 

4 outer image display signal, by detecting the motion, brightness and color characteristics of 

5 the left inner image display signal. 

6 In step S28, the left and right outer region image display signals is blended with 

7 their respective inner region image display signals so that the right image and the left image 

8 appear to be continuous across the right and left displays 42, 44. This may be referred to as 

9 creating a relatively continuous, or "soft" transition zone between the inner and outer 
10 regions of the right and left displays. For example, the right inner region image display 

^ 1 1 signal can be blended with the right outer region image display signal by using interpolation 

Co 

m 12 or averaging algorithms to blur pixels in region 63, creating more blur in pixels near the 

13 region 70 than in the region 62. The left outer region image display signal can be similarly 

14 blended with the left inner region image display signal. 

E 

i"^ 1 5 Alternatively, the inner and outer regions may be blended by optics after the right 

16 and left images are displayed by the right and left displays 42, 44. Referring to Fig. 6, the 

P 1 7 right optics 46 can be adapted to "smear" or "blur" adjacent edges of the inner and outer 

18 regions so that the outer regions appear to blend more smoothly with the inner regions of 

1 9 the right and left displays 42, 44. 

20 In addition to electronic and/or optical blending, the right and left images may be 

21 enhanced by a leaving a gap between the inner region 60 and the outer region 70 of the right 

22 display 42. The left display 44 may similarly include a gap between its inner and outer 

23 regions. The gap allows the user to focus on the inner region of a display and to not have 

24 the inner region image degraded by the nearby presence of the outer region of substantially 

25 lower resolution. The gap may be, for example, between 2 and 20 degrees in width. 
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1 After adjusting the inner and outer images in step S28, the processor 54 then 

2 transmits formatted image data values from the inner and outer image signals to a respective 

3 one of the right and left frame buffers 55, 59 in step S30. 

4 The above discussion is discussed in general terms with reference to a right display 

5 42 and a left 44 display of varying resolution. The present invention, however, is not 

6 restricted to display panels, or "microdisplays" having a specified number of pixels that 

7 create an image when illuminated. The present invention also encompasses displays created 

8 by transmissive or reflective LCD's, electroluminescent, plasma, LED, and flat CRT's that 

9 create either virtual or projected images to the eye. Further, small scanning display devices 

10 using CRTs, and laser diodes used to create small displays, or to write directly on the retina, 

1 1 may also be used. 

12 Fig. 1 1 illustrates an arrangement of regions of a display 75, according to an 

1 3 alternative embodiment of the present invention. 

14 The display 74 includes first, second and third regions 76, 77, 78, with the resolution 
ill 15 of the first through third regions 76, 77, 78 decreasing outwardly from a center 75 of the 

16 display 74. The first through third regions 76, 77, 78 may have a configuration similar to 

17 the first through third regions 61, 62, 63 of the right display 42 illustrated in Fig. 8. An 

18 outer region of the display 74 includes a right outer region 80 and a left outer region 82. 

19 Fig. 12 is a schematic diagram of an alternative embodiment of an image display 

20 device 90 according an embodiment of the present invention. 

21 The image display device 90 comprises a display 92 and a controller 94 which 

22 includes a processor 95. Optics 98 may be included to modify the images displayed by the 

23 display 92. An image source 96 is coupled to the processor 95 to provide a source image 

24 signal. The image display device 90 operates in a manner similar to the image display 
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1 device 40, except that only a single display 92 is used to create an image for viewing by a 

2 user. 

3 The image display device 90 utilizes a display having inner and outer regions, such 

4 as the displays 42 and 74 illustrated by Figs. 8 and 1 1, respectively, or other display 

5 configurations utilizing an inner region and an outer region of substantially lower 

6 resolution. 

7 The above embodiments discuss methods in which an image having a wide field of 

8 view is displayed from an inner region and an outer region of low resolution. Figs. 13-16 

9 illustrate an alternative method of expanding the field of view of a display using distortion 
10 of the edges of a display. Distorting the edges of an image allows an image to fill an outer 

Iri 1 1 region of a display having lower resolution than an inner region of the display. 

f n 

in 12 According to the embodiment illustrated by Figs. 13-16, a display signal is adapted 

Ul 13 to present an image with distortion along the edges of the display. The distortion may be 

Q 14 introduced during processing of the image display signal. The embodiment illustrated by 

^ 15 Figs. 13-16 can be practiced on an image display device 40 as illustrated by Fig. 6, or on an 

^ 16 image display device 90 as illustrated by Fig, 12. In the present embodiment, however, 

17 image data from the source image signal is adjusted so that an image displayed using the 

1 8 image data is distorted at the edges of the display, thereby expanding the field of view of the 

19 display into an outer region of a display. 

20 Fig. 13 illustrates an image as it would appear on an image display 110 without 

21 using distortion. Fig. 14 illustrates an image similar to the image of Fig. 13, displayed on a 

22 larger display 102, with a distorted region 124 of the image being extended, or "stretched" 

23 to fill the larger display 102. 

24 As illustrated by Figs. 13 and 14, an inner region 122 of the image on the display 

25 102 generally corresponds to the inner region 1 12 of the image displayed on the display 



HP 10006196-1 



16 




1 110. The outer region 124 displayed by the display 102, however, extends the field of view 

2 of the image of the display 102 so that it is larger than the image presented by the display 

3 110. Because the outer region 124 is produced from distorted image data, the resolution of 

4 the outer region is lower than that of the inner region 122, The outer region 124, however, 

5 retains the motion, brightness, and color characteristics of a source image signal. Because 

6 the human eye is less sensitive to detailed color and pattern vision in the outer region 124, 

7 the image presented to the user is enhanced, without sacrificing the sense of clarity 

8 conveyed to the user. 

9 Fig. 15 is a flow chart illustrating a method of displaying images according to the 

10 embodiment of the invention illustrated by Fig. 14. The method of displaying images 

1 1 illustrated by Fig. 15 will be discussed with reference to an image display device 100 

12 illustrated by Fig. 16. 

13 In step S70, an image source 106 transmits a source image signal to a processor 108 

14 of a controller 104. The processor 108 then samples the source image signal in step S72, 

15 and determines how the data sampled from the source image signal is to be distorted in step 

16 S74. For example, the source image signal may be sampled so that an image signal 

17 corresponding to the image of Fig. 13 is suitable for display on a display 110. In step S75, 

1 8 the controller 104 adjusts the sampled image signal data so that an image signal 

19 corresponding to the image of Fig. 14 can be generated in step S76. One method of 

20 distortion would be to distort, for example, the outer 1 5 to 50 degrees of field of view of an 

21 image such that the image extended to cover, for example, 20 to 90 degrees about the line of 

22 sight 1. The distortion could become more pronounced with distance from the center of the 

23 display 102, where the eye's acuity is lower. For example, in the outer region 124, near the 

24 edge of the inner region 122, the distortion ratio between the outer region 124 and the inner 
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1 region 122 could be between, for example, 1:1 and 10:1, and could increase to between 2:1 

2 and 20: 1 near the outermost edge of the outer region 124. 

3 In step S76, the controller 104 generates a display signal using the adjusted image 

4 data, which is transmitted to the display 102 in step S78. The display 102 displays the 

5 image in step S80. 

6 The sampled image signal data can also be distorted by, for example, microdisplay 

7 panels that photolithographically distort the image, and mechanical scanning devices. 

8 The outer region 124 of the display 102 can be of substantially lower resolution than 



9 the inner region 122. For example, displays such as those illustrated by Figs. 8 and 1 1 can 

10 be used in the image display device 110. In this case, the outermost edges of the image 

J 1 1 illustrated by Fig. 14 would be displayed by the outer regions of the displays of Figs, 8 and 

Iri 12 11- 

1=1 13 According to the embodiment illustrated by Figs. 13-16, the outer region of the 

Cb 14 source image may be selected so that it lies outside of the eyes' foveal field of view, so that 

a 1 5 the distortion does not detract from the user's viewing experience. The viewing experience 

Ifl 

U 1 6 is enhanced by the increased size of the image displayed by the display 1 02. 

\Q 

Q 17 As an alternative to distorting the image signal data in order to obtain a display 

18 signal, a distorted image can be obtained by utilizing optics, such as the optics illustrated in 

19 Fig. 16. For example, the optics 108 in the image display device 100 can be configured to 

20 create the distortion of the image of Fig. 13 so that it is distorted in the general manner 

21 illustrated by Fig. 14. 

22 In this embodiment, a nondistorted display signal is transmitted to the display 102, 

23 and the optics 108 distort the image presented to the user by magnifying edge regions of the 

24 image from the display to a greater degree than the inner portion of the image. For 

25 example, in the foveal region (0-20 degrees field of view), the magnification can be 
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1 relatively uniform. The magnification can increase progressively, outwardly from the 

2 foveal region, so that at the outermost regions of the image, the distortion ratio is between, 

3 for example, 2 : 1 to 20 : 1 . 

4 The terms and descriptions used herein are set forth by way of illustration only and 

5 are not meant as limitations. Those skilled in the art will recognize that many variations are 

6 possible within the spirit and scope of the invention as defined in the following claims, and 

7 their equivalents, in which all terms are to be understood in their broadest possible sense 

8 unless otherwise indicated. 
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